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BASIC NATIONAL FEE (37 CFR 1.492(a)(1H5)): 

Neither international preliminary examination fee (37 CFR1 .482) nor international search fee 
(37 CFR1 .445(a)(2)) paid to USPTO and International Search Report not prepared by 
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International preliminary examination fee (37 CFR 1,482) not paid to USPTO but International Search 

Report prepared by theEPOorJPO $890 00 

International preliminary examination fee (37 CFR 1482) not paid to USPTO but international search fee 

(37 CFR 1.445(a)(2)) paid to USPTO $ 740.00 

international preliminary examination tee (o7 GFR 1 .482) paid to USPTO but all claims did not satisfy 

provisions of POT Article 33(1)-(4) $710 00 

international preliminary examination fee (37 CFR 1.482) paid to USPTO and all claims satisfied provisions 
of PCT Article 33(1)~f4) SI 00 00 
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Please charge my Deposit Account No. 25-01 20 in the amount of $ to cover the above fees. A duplicate copy of this sheet is enclosed. 

The Commissioner is hereby authorized to charge any additional fees which may be required by 37 CFR 1 .16 and 1 .17, or credit any overpayment to 
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X13 RiS^d PCT/PTO 30 NOV 2001 

PATENTS 

IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 
In re application of 
Rogier EIJKELHOF 
Serial No. (unknown) 
Filed herewith 
METHOD FOR DATA PROCESSING 

PRELIMINARY AMENDMENT 

Commissioner for Patents 

Washington, D.C. 20231 

Sir : 

Prior to the first Official Action, please substi- 
tute page 1 and pages 4-10 of the specification as originally 
filed, with page 1 and pages 4-10 as filed in the Article 34 
amendment of August 20, 2 001. The pages are marked "AMENDED 
SHEET^' and are attached hereto. 

Prior to the first Official Action and calculation 
of the filing fee, please substitute Claims 1-12 as originally 
filed, with Claims 1-10 as filed in the Article 34 amendment 
of August 20, 2001. The pages containing Claims 1-10 are 
marked "AMENDED SHEET" and are attached hereto. Following the 
insertion of Claims 1-10, please amend these claims as 
follows : 

IN THE CLAIMS : 



Amend claim 4 as follows: 



Rogier EIJKELHOF 

--4. (Amended) Method according to claim 1 charac- 
terized in that the direction in which said adjustement is 
performed depends on the relative difference between said 
target value calculated by weighted interpolation (P and 
said minimum and maximum value (Imin/ Imax) 

Amend claim 5 as follows : 

--5. (Amended) Method according to claim 1 charac- 
terized in that use is made of weighted interpolation on the 
basis of a non-linear density distribution which assigns a 
heavier weighting to source values located closer in the grid 
than to source values located further away, in particular a 
Gaussian distribution, at least an exponential density 
distribution . - - 

Amend claim 6 as follows : 

--6. (Amended) Method according to claim 1 charac- 
terized in that a source value which lies in the grid closest 
to the target value to be determined, is taken as source of a 
region extending over a finite number of mutually adjacent 
source values and that the local maximum and the local minimum 
are determined in this region. -- 

Amend claim 10 as follows: 

--10. (Amended) Method according to claim 1 
characterized in that the final target value is a weighted 
average of the target value determined on the basis of 
interpolation and the local maximum and minimum, wherein a 
weighting factor is employed which depends on average local 



Rogier EIJKELHOF 
dynamics of the source values located around the target value 
to be determined and the relative location of the target value 
determined on the basis of interpolation relative to the local 
maximum and minimum. -- 

REMARKS 
The above changes in the specification and claims 
merely place this national phase application in the same 
condition as it was during Chapter II of the international 
phase, with the multiple dependencies being removed. Follow- 
ing entry of this amendment by substitution of the pages, only 
claims 1-10 remain pending in this application. 
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Rogier EIJKELHOF 
Attached hereto is a marked-up version of the 
changes made to the claims by the current amendment . The 
attached page is captioned ^WERSION WITH MARKINGS TO SHOW 
CHANGES MADE" . 

Respectfully submitted, 
YOUNG 5c THOMPSON 




Benoit Castel 
Attorney for Applicants 
Registration No. 35,041 
Customer No. 00466 
745 South 23^^ Street 
Arlington, VA 22202 
Telephone : 703/521-2297 

November 30, 2 0 01 
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Rogier EIJKELHOF 
VERSION WITH MARKINGS TO SHOW CHANGES MADE 

The claims have been amended as follows: 
4. (Amended) Method according to any of the — 

preceding claimsclaim 1 characterized in that the direction in 
which said adjustement is performed depends on the relative 
difference between said target value calculated by weighted 
interpolation (Pt) and said minimum and maximum value (1 

1 max ^ * 

5 . (Amended) Method according to any of the 

preceding claiiiisclaim 1 characterized in that use is made of 
weighted interpolation on the basis of a non-linear density 
distribution which assigns a heavier weighting to source 
values located closer in the grid than to source values 
located further away, in particular a Gaussian distribution, 
at least an exponential density distribution. 

6. (Amended) Method according to any ul Lhe — 

preceding claimsclaim 1 characterized in that a source value 
which lies in the grid closest to the target value to be 
determined, is taken as source of a region extending over a 
finite number of mutually adjacent source values and that the 
local maximum and the local minimum are determined in this 
region . 

10 . (Amended) Method according to an y of — thre — 

preceding claimsclaim 1 characterized in that the final target 
value is a weighted average of the target value determined on 
the basis of interpolation and the local maximum and minimum, 

5 



Rogier EIJKELHOF 
wherein a weighting factor is employed which depends on 
average local dynamics of the source values located around the 
target value to be determined and the relative location of the 
target value determined on the basis of interpolation relative 
to the local maximum and minimum. 
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Method foi data processing 



Hie present invention relates to a method for processing data in the foixQ of a grid of discrete 
soiirce values, wherern at least one target value -wiUmi a region of source values is determined 
by means of interpolalion in said region of source values. 

Sudi a method can be used for data of diverse nature, and particularly to expand, oompress 
or decompress computer data with a non-critical bit value, such as for instance sound and 
animatioa files. The starting point is always a one- or m.ulti-dimeDsional grid of discrete source 
values among which concrete target values have to be predicted by means of interpolation. 
The source values herein compiise nuruerical values which, in ths case of for instance an 
image, indicate the colour intensity of a basic colour present thcxein and, in the case of a 
sound file, represents the frequency, i,e. the pitch, oriia intensity thereof. In tie case of other 
types of data a different mfoiraation component in the source data will similarly be taken as 
measore. 

For digital itnases there exists a number of more or less standardized forms in whicla data 
is stored- The so-called bitmap format is for instance a farm wherein the data is stored in a 
series of discrete numerical values. This series can be converted comparatively simply into a 
two-dimensional matrix of source values wMda ea^i indicate the colour iatensily of pixels 
coixesponding merewith. la a monochromatic image there thus results a single matrix, while in 
a colour image such amatrix can be constructed for each of the basic colours. 

One of the simplest ways of enlarging such an image is to escpand the discrete pixels. The 
result hereof is shown in figures 1 and 4. wherein the lower image T 1 is roughly a five-fold 
ejjlargement of the source image S. It can be seen clearly that such a method of enlargement 
detracts sigl±5cantly from the resolution of the final image. Because each pixel of the source 
image S reappears in lite result Tl as a rectangular image area of aumfonn colour (intensity), 
a clear block structure is created whici does not coirespond with the original source image. 
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Tn the context of the present iavcntion local dynamacs ia thie source values are understood to 
mean the degree in whidi tte source values in tke relevant xegioii differ from eacJi other and 
also the steepness with which these differences are present, A further panicular embodiment 
of the method according to the invention comprises in this respect an algoiithm which assigns 
a numerical value hereto and i5 characterised for this purpose in that the dynamics are derived 
firom a noimalired difference between a source value and an average of all source values in 
the second region. For the average of all source values in liie second region a weighted 
average is herein preferably taken which, assigns a heavier weighting to source values located 
closer in the grid than to source values located furfher away and which pandculaxiy utilizes a 
non-linear deasity distribution for the purpose of deterrniaiiig the weighting faciors and more 
particularly a Gaussian disiribulion, at least an exponential density distcibutioii. 

In order to determine the different factors which play a part in predicting the target value 
within the scope of the invention, the starting pbint is always a number of source values in a 
finite first and second region as &ame of reference. Relatively fer-removed source val.ues can 
be ignored because they make no or hardly any contribution to^vards Iho precision with which 
the target value is calculated and can even detract from this precision in that 'flu^e is alack of 
any relationship with the target value for predicting- The calculation time of the method 
moreover increases when more source values are taken as frame of reference. Conversely, 
only one or two reference values wiH in many cases be too few to enable prediction of the 
target value in reliable raanner. A particular embodiment of the mediod accordiag to the 
invention has been found effective in practice wh^ein the first and second region both extend 
over niae sonrce values in the grid. 

The adjustment of the interpolated value to the local maximum. or rniniiuum within the scope of 
the present invention can be performed se in diverse ways. A further particular 
embodiment of the method according to the anvexLtion is however characterized in thai the final 
target value is a weighted average of the target value determined on the basis of iaterpolation 
and the local -mayi-mn-m and mnniTmrn ^ wherein a weightiag factor is employed wbich depends 
on average local dynamics of the source values locaied around the target value and the 
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relative location of the target value determiaied on the "basis of interpolatioii relativeto the local 
TTi^.-x^TTnirn and njjxmii'um. 

la order to determme tiie local Tni-niTna^ maxima and dynainics it isper se possible to carry o'Ot 
a separate calculatioiL for each target value to be determined. A prefetrsd embodiment of the 
method according to the invention is however characterized in that for all source vahiss an 
associated local TniTiirmiTn aad maximum and an associated dynamic value is determinsd 
beforehand so as to be read for the p-mpo'se of detemDioing the target value, A calculation is 
hsrdn performed once for aU source values together in order to detenoine said values, so that 
these axe then immediately available, This saves considerable calculation time since 
calculations which would otherwise be performed repeatedly now take up calculation time 
once-only. 

The invention is not only suitable for data with only a single information component but also 
for data in the form of source values with separate numerical values for separate information 
components. In accordance with a further embodiment of the method according to the 
invention, for each iaformadon component a target value located among the sourcevalues is 
herein detemuned individually for this information component. 

The invention will now be farther elucidated -wiiii reference to an embodiment and an 
associated drawing, ha the drawing: 

figurel shows the enlargement of a jflxst image based on an existing techoique making using of 
pixel eKpansion; 

Sgure2 shows an eiiLargement of the first image based on a second existing technique inaking 

using solely of pixel interpolation^ 
figure 3 shows an enlargement of the first image based on an embodiment of the 

method according to the pressaat invention; 
figure 4 shows the enlargeamant of a second image based on an existing technique 

making using of pixel escpaasion; 
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figure 5 shows an solargement of the second image hased on a second existing 

technique mzidug using solely of pixel inteipolatioii; and 
fisure 6 shows an snlsrgemjent of the second image based on the embodiment of the 

method according to the present invention used in figure 3. 

Although the invention lends itself in principle to any type of data wherein the exact bit value is 
not critical, it is best elucidated within tbe scope of the present invention on the basis of axL 
example vdth graphic data in the foim of an image S. The daxa on the basis of which the image 
can be constructed is possibly already in the form of a grid or matrix coiresponding with the 
pixels of the image, with for each pixel a numerical soiirce value indicating a colour value or, 
with a view to the method accordiag to the inveatiori, is brought into such a form. In the csise 
of a monochromatic image the colotir value amounts only to aa intensity, for instance a grey 
valuej in the case of a colour image this will be a set of for instaDce three values, one for each 
basic colour- A much used format in which images are digitally stored is the so-called bitmap 
format which, for each pixel of a colour image, comprises three channels of S bits each, and 
therefore has 256 values for each basic colour, This format can be employed relatively 
directly by the method according to the invention, other formats possibly require a conversion 
ftimilar to that with which such a fcimat is transferred to the (image) memory of a computer, 

Assuirmig a black/white image a part of the thus assembled matrix is shown by the grid of 
figure 7, wherein the poiots in the grid represent the pixels of the source image S with for each 
grid point Sy- a discrft© value of I|f firom 0 to 255 J&om the malxis to thereby designate the grey 
value of the relevant pi^ceL In order to enlarge such an image while retainiag resolution, 
intemediate points have to be created, of which the value of the grey value has to be 
calculated, One of these points T is shown hi the figure, 

A first estimate of the grey value I, of the inteimediate pixel T can be obtained by inteipolation 
on the basis of the values of the suiromdiag pi^cels. The point of departure herefor in this 
example is a weighted average of the values of the suixounding pixels, wherein the weighting 
assigned to each pixel is highly dependent on its distance from T- A more partictdar point of 
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departure herein for tke weigjiting fectors is a noimalized Gaussian distribuiioii, of which pixel 
T forms the oxigiD, Because of the sharp fall in the weighting factors according to this cmve, a 
finite region A of for instance 4x4 pixels aroimd T sufiSces for the inteipolatiaii, which pixels 
axe hatched in the figure. On the hasis of this interpolation m intetpolated grey value Pt results 
for the pixel T to be calculated in accordance with the following relation: 

According to the invention a local maxiiuum and a local Tnini-rnum arougd the pixel T to be 
calculated is also determined ia addition to the irxteipolated value P^. la the embodiment 
described here the starting point for this puipose is a reference region B of 4x4 pixels S.^ 
i,So,o-"S2^ an origin Sd.o of which is formed by the pixel in the original image lyiag just in front 
of the pixeLfor calculating. This region is shown hatched in the figure. A local maximum 1^^ 
and a local minimmnlm^n of the grey values of the originalpixels are deterniiaed 'withia this 
region. 

In addition, the local dynamics in the grey values are determined according to the invention 
withia a reference region aroimd the pixel T for calculating- The starting point therefor ia tbis 
embodiment is the same reference region B as that in which the local irnmmum and maximum 
have been deterroined. These dynamics provide a measure for the hardness or contrast of the 
image and are derived in this embodiment from the ncnnalized average difiference between the 
grey values of the pixels in reference region B and a weighted average of the pixels in a 
reference region C of 5x5 pijcels around the pixel S^j for which the local dynamics has to be 
calculated, This region C therefore differs for each pixel S^- and is indicated by way of 
example in the figvixe for Sqq- This is expressed in the following foimula: 

Cif)eB 



y^fhere Ij^m ~ 2 Y^Oa^^ I and 2 ^« = ^ 
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The- starring point for the weighted average l^^ here are weightiiig factors on the hasis of 
a normaUzed Gaussiau cJistributioii which attributes a greater weighLting to pixels close to the 
pixel T for calciilating than to ftirther removed pixels. For the resT;Llting factor D^j there applies: 
5 0 < < 1 . value D— 1 indicates thai lbs source image ta the relevant region is vftry hard, 
i.e. has very sharp transitions in intensity, while a value Dy"=0 iadicaies precisely the opposite, 
i.e. no differences in intensity occur within the region. The local dynainics D^. associated with 
the pixel T to he calculated are derived from the weighted average of the values D^,- from the 
reference region B around the pixel T to be calculated, 

10 

The grey value of the pixel T to be calctilated is established by adjusting the interpolated value 
P, to the local maximum or TnTniTmim on the basis of the Hhm foimd hardness value Di- Taken 
for this purpose in this embodment is a weighted average of Pt and the local maximum and 
minirmim , wherein aweighting factor is apphed wiuch depends on the difierence from Pt and is 

15 proportional to the hardness value D^. This is expressed for instance by the following fonnula 
apphedinthis 
example: 

where sino(0 = K + K-sm(57:Cr- K) and siiifi(0 = sing.sinn- i(^) wzY/z 5 

20 If in liie relevant reference region B the source image is completely level and has no 

differences in intensity, which is reflected by a value D=^0, no shifting or adjustment of the 
interpolated value takes place. In the case of a comparatively hard image with great 
differences in intensity, wherein D will move in the direction of a value D=f 1^ the adjustment 
will in contrast be maximal. The final value 1^ will in that case be shifted to the local mirmnum 

25 or maximum, depending on which value lies closest to the interpolated value P^, thereby 

resulting in more definition. The local dynaomcs of the original image S are thus taken into 
account in the final grey value It, which is calcxilated for the pixel T- to be added. 



Xnin + {ixnor ^ Im in) - Sinn^ 



Im (21 — Ii 
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The foregoing algoiitim is applied for all pixels which have to be calculated amoxig or 
adjacently of the original pixels in order to create the dstsired ealargemem while retaining 
resolution. In practioe this means tial for all pixels of the original source image ike associated 
local maxrma, mininia and average hardness values are calculated beforehand so that these are 
then immediately available for the above stated calculations. The stated algorithm allows of 
simple tcaxislation into compntKT software wtli which a smtable computer can "be loaded to 
perform the calculations fuHy automaticaUy- In anser interface adapted thereto setting options 
can be offered for fine-tuning of the size of the reference regions, the relations for the 
weighting factors and other parameters- 

The result on the basis of this embodiment of the method according to the invention is shown 
in figures 3 and 6 for respectively a relatively hard source image in the form of a sharply 
defined character and a more variegated source image corresponding with a photographic 
image. It can clearly be seen that the definition of the character in figure 3 has been reiained 
despite the great enlargement £hereo£ while the variegation in the image of figure 6 is retained 
with the method according to the invention and is even better preserved than on the basis of 
solely an interpolatiorL method as shown in figure 5. 

Although the invention has been further elucidated above with reference to only two 
embodiments^ it will be apparent that the invention is by no means limited to the given 
embodiments. The invention can thus also be applied to images with more colours, wherein 
the above stated algorithm is applied separately to each basic colour- The invention can 
advantageously also be applied for the intexpolation of sound data and other data with 
noncriticalbit values while retaioing dynamics. The above stated wdghting factors and fiames 
of reference, although very effective, have been given solely as examples. Depending on the 
concrete situation, a fine-tuning thereof can t^e place to further enhmce the quality of the 
final result. Larger, smaller or identical reference regions can for instance thns be apphed to 
calctiLate the various above stated factors and, in order to determine the final grey value of the 
pixel for calculating, a different algorithm can also be chosen which takes account of the local 
dynanrics derived in this pixel and the local maxTrnuTn and m^ - nirnum . 
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Th© tflveation generally provides a method of interpolatiag data while retainiiig d>Tiainics, 
TvhictL impKes that the character and th.e definition of the source data is retained to a significant 
degree in the result. 
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Claims 

1 . Metitod for processing data in the form of a grid of discrete source values^ wlxerein at 
least one target value (T) wrtiun a region (A) of souice values is dexenmned by means of 

5 mteipolation in said region (A) of source values diaracTerised in that a TniTi^TriTirn value (Ipji«) 
aud a maximtim value (I^sx) detex3xdned within a local region of source values around the 
target value (T)^ in that a msasure of tie dynamics is determiaed within a local regLon (B) of 
source valxies around the target value (T) and in that the target value is calculated by weighted 
interpolation is adjusted in the direction of either said mioimuin value or said maximuni value 

10 on the basis of said dexennined measure of tb,e dynamics. 

2- Method according to claim 1 characterised in that said measure of dynamics is 
deterrnmed as anonnalizcd weighted value of th.e absolute differences Q\J^^ - Ig«Jl) ia source 
values v/ithin said local region (B). 

3. .Method according to claim 2 characterized in that one of said absolute differences 
(lilu - IgcmCij>lD is calculated for each one of the soiirce values in said local region (B), and in 
that each said difference (jfl^ - IgcmCii)!!) ^ calculaied between a given one (Tg, ij EB) of said 
source values aad a weighted average (IgcmCfj)) source values in a ftLrther local region (C) 

20 cotxespondiog to said given one source value. 

4. Method according to any of the preceding claims characterized in that the direciion in 
which said adjustement is pexfomied depends on the relative difference between said target 
value calculated by weighted interpolatioa {PJ and said rniniirmm andxoajdmum value 

5. Method according to any of the preceding claims chaxacrcrized in that use is made of 
weighted interpolation on the basis of a non-linear density distribution which assigns a heavier 
weighting to source values located closer in the grid than to source values located finthar 

30 away, in particular a GHussian distribution^ at least an exponential density distribution. 



6- Method according to any of the preceding claims characterized in that a source value 
which lies in the grid closest to the target value to he deterrminsd, is taken as sciarce of a 
region extending ov^ a finite number of xautually adj acent source values and that the local 
maximum and the local minimum axe detennined in this region, 

7, Method as claimed in daim 6, characterised in that the measure for the dyn ami cs 
the source values is detenrruied ia a second region extending over a finite number of rr jally 
adj acent source values, which second region is optionally of the same size as the first region in 
whidi the local majdmum and mi-nirm-nrrj are determined, 

S- Method as claimed in claim 7, chaisctcdzed in iJiat the dynamics are derived firom a 
normalized difference between a source value and an average of all source values in the 
second region. 

9- Method as claimed in claim S, characterized in that for the average of all source values 
in the second region a weighted average is taken which assigns a heavier weighting to 
source values located closer in the grid than to source values located fiirthjsr away and which 
particularly udlizes a non-linear deosity distribution for the purpose of detenniaing the 
wei^ting factors and more particularly from a Gaussian distribution, at least from an 
exponential density distribution. 

10. Method according to any of the preceding claims characl^rized ia that the final target 
value is a weighted average of the target value determined oji the basis of interpolation and the 
local maximum and ininimum, whereia a weighthig factor is enrployed which depends on 
average local dynamics of the sotarce values located around the target value to be deteonined 
and the relative location of the target value detemined on the basis of interpolation relative to 
the local maximum and minimum. 
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ABSTRACT OF THE DISCLOSURE 

In a method for processing data in the form of a 
grid of discrete source values, at least one target value 
situated among the source values is determined by 
interpolation. Account is also taken of the character and 
the definition of the source data by determining a local 
minimum and a local maximum of the surrounding source 
values in a region round the target value for determining 
and by determining a measure for the dynamics of the 
surrounding source values in a region round the target 
value to be determined. The target value calculated by 
interpolation is adjusted in the direction of either the 
local maximum or the local minimum on the basis of the thus 
calculated measure for the dynamics of the surrounding 
source values in order to express the character and the 
definition of the source data. 
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Method for data processing 

The present invention relates to a metiiod for processing data in the form of a grid of discrete 
soiarce values, wherein at least one target value within a region of source values is determined 
hy means of interpolation in said region of source values. 

Such a method can be used for data of diverse nature, and particularly to expand, compress 
or decompress computer data with a non-critical bit value, such as for instance sound and 
animation files. The starting point is always a one- or multi-dimensional grid of discrete source 
values among which concrete target values have to be predicted by means of interpolation. 
The source values herein comprise numerical values which, in the case of for instance an 
image, indicate the coloisr intensity of a basic colour present therein and, in the case of a 
sound file, represents the frequeacy^ i.e. the pitch, or the intensity thereof. In the case of other 
types of data a different information component in the source data will similarly be taken as 
measure. 

Fox digital images there exists a number of more or less standardized forms in which the data 
is stored. The so-called bitmap format is for instance a form wherein the data is stored in a 
series of discrete numerical values. This series can be converted comparatively simply into a 
two-dimensional matrix of source values which each indicate the colour intensity of pixels 
corresponding therewith. In a monochromatic image there thus results a single matrix^ while in 
a colour image such a matrix can be constructed for each of the basic colours. 

One of the simplest ways of enlarging such an image is to expand the discrete pixels. The 
result hereof is shown in jSgures 1 and 4, wherein the lower image T I is roughly a five-fold 
enlargement of the source image S. It can be seen clearly that such a method of enlargement 
delxacts significantly from the resolution of the final image. Because each pixel of the source 
image S reappears in the result Tl as a rectangular image area of a uniform colour (intensity), 
a clear block structure is created which does not correspond with the original source image. 
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A better result is obtained by determining target values among the source values in the 
output data by interpolation. In the case of an image the most probable colour value of an 
intermediate target value is herein determined on the basis of the colour values of a group of 
surroxmding pixels. The starting point here is preferably a weighted average of the coloxor 
values of the surrounding pixels, wherein a heavier weighting is normally assigned to pixels 
located closer than to pixels located further away. The result of such a method, which is 
applied by many modem graphic computer programs in a form which may differ somewhat 
from each other, is shown in figures 2 and 5. The point of departure is the same soiorce 
image S and the same enlargement factor as in the other figtires to obtain the end result T2. 
A block structure as in a simple pixel expansion is thus avoided to a significant extent in 
that pixels of the source material S are as it were smeared in the end result T2. While for an 
image such as that in figure 5 this does produce a reasonable result, the image of figure 2 
still loses a lot of its definition because the edges of the image become relatively blurred. 
Such blurred edges are relatively unavoidable assuming an interpolation technique since 
interpolation between black and white as in the present image will always produce a certain 
grey value at the edges. The larger the enlargement chosen, the more pronounced this effect 
becomes. 

The present invention has for its object to provide a method of the t>^e stated in the 
preamble which to at least a significant extent prevents such a blurring of the image, so that 
the quality of the image is better preserved. 

In order to achieve the stated objective a method of the type stated in the preamble has the 
feature according to the invention that in a region round the target value for determining a 
local minimum and a local maximtim is determined of the surrounding source values, that in 
a region round the target value to be determined a measure for the dynamics of the 
surrounding source values is determined and that the target value calculated by interpolation 
is adjusted in the direction of either the local maximum or the local minimum on the basis 
of the calculated measure for the dynamics of the surrounding source values. Not only is an 
intermediate value herein determined by interpolation, an analysis is also carried out in the 
source data in order to defme the dynamics or contrast thereof in at least the region where a 
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new target value has to be calculated. On the basis of the thus determined dynamics the 
interpolated value is adjusted more or less to the value of a local minimum or maximum. In 
the case of for instance an already relatively blurred source image, the thus adjusted target 
value will not differ from the interpolated value, or hardly so, but in the case of a relatively 
dynamic image with sharp local differences in the source values this adjustment will be 
capable of shifting the interpolated value considerably toward the local maximum or 
minimum so that the contrast in the source data is retained to a significant degree. The result 
T3 of an embodiment of the method according to the invention is illustrated in figures 3 and 
6, utilizing the same source image S and expansion factor as in the other figures, and clearly 
shows the improvement compared to the existing expansion techniques. 

In a particular embodiment the method according to the invention has the feature that a 
source value which lies closest to the target value for determining in the grid is taken as 
source of a region extending over a finite number of mutually adjacent source values and 
that the local maximum and the local minimum are determined in this region. In order to 
determine the local minimum and maximum for each target value which has to be calculated 
a uniform framework is herein always used as starting point with just as large a number of 
source values as reference. The same applies for the determining of the local dynamics of 
the source values in a further particular embodiment of the method according to the 
invention, characterized in that the measure for the dynamics of the source values is 
determined in a second region extending over a finite number of mutually adjacent source 
values, which second region is optionally of the same size as the first region in which the 
local maximum and minimum are determined. 

In the context of the present invention local dynamics in the source values are imderstood to 
mean the degree in which the source values in the relevant region differ from each other and 
also the steepness with which these differences are present, A further particular embodiment 
of the method according to the invention comprises in this respect an algorithm which 
assigns a numerical value hereto and is characterized for this purpose in that the dynamics 
are derived from a normalized difference between a source value and an average of all 
source values in the second region. For the average of all source values m the second region 
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In the context of the present invention local dynamics in the so^ce values are understood to 
mean the degree in which the source values in the relevant region differ from each other and 
also the steepness with which these difierences are present. A further particular embodiment 
of the method according to the invention comprises in this respect an algorithm "which assigns 
a numerical value hereto and is characterized for this purpose in lhat the dynamics are derived 
from a normalized difference between a source value and an average of all source values in 
the second region. For the averse of all source values in the second region a weighted 
average is herein preferably taken which assigns a heavier weighting to source values located 
closer in the grid than to source values located further away and which particularly utilizes a 
non-linear density distribution for the purpose of determining the weighting factors and more 
particularly a Gaussian distribution, at least an exponential density distribution. 

In order to detennine the different factors which play a part in predicting the target value 
within the scope of the invention, the starting point is always a number of source values in a 
jBnite first and second region as frame of reference. Relatively far-removed source values can 
be ignored because they make no or hardly any contribution towards the precision with which 
the target value is calculated and can even detract from this precision in that there is alack of 
any relationship with the target value for predicting. The calculation time of the method 
moreover increases when more source values are taken as frame of reference. Conversely, 
. only one or two reference values will in many cases be too few to enable prediction of the 
target value in reliable manner. A particxJiar embodiment of the method according to the 
invention has been found effective in practice wherein the first and second region both extend 
over nine source values in the grid. 

The adjustment of the interpolated value to the local maximum or TniniTnuni within the scope of 
the present invention can be perfoimed per se in diverse ways, A further particular 
embodiment of the method according to the invention is however characterized in that the final 
target value is a weighted average of the tacrget value determmed on the basis of interpolation 
and the local maximum and mim'Tnum, wherein a weighting factor is employed which depends 
on average local dynamics of the source values located around the target value and the 
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relative location of the target value detennined on the basis of interpolation relativeto the local 
maxinnini and minimum. 

In order to determine the local miTiima, maxima and dynamics it isper se possible to carry out 
a separate calculation for each target value to be detemiined. A preferred embodiment of the 
method according to the invention is however characterized in that for all source values an 
associated local -mmtmnTn and maximum and an ^sociated dynamic value is detennined 
beforehaad so as to be read for the purpose of determining the target value. A calculation is 
herein performed once for all source values togeliier in order to determine said values, so that 
fbese are then immediately available. This saves considerable calculation time since 
calculations which would otherwise be performed repeatedly now take up calculation time 
once-only. 

The invention is not only suitable for data with only a single information component but also 
for data in the form of source values with separate numerical values for sqparate information 
components. In accordance wifli a jfurflier embodiment of the method according to the 
invention, for each information component a target value located among the sourcevaiues is 
herein determined individually for this information component 

The invention will now be ftirther elucidated with reference to an embodiment and an 
associated drawing. In the drawing: 

figtirel shows the enlargement of a first image based on an existing technique maldng using of 
pixel expansion; 

figure2 shows an enlargement of the first image based on a second existing technique making 

using solely of pixel mterpolation; 
figure 3 shows an enlargement of the first image based on an embodiment of the 

method according to the present invention; 
figure 4 shows the enlargement of a second image based on an existing technique 

making using of pixel expansion; 
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figure 5 shows an enlargemeat of the second image based on a second existing 
technique making using solely of pixel inteipolatioii; and 

figure 6 shows an enlargement of the second image based on the embodiment of the 
method according to the present invention used in figure 3. 

5 

Although the invention lends itself in principle to any type of data wherein the exact bit value is 
not critical, it is best elucidated within the scope of the present iavention on the basis of an 
example with graphic data ia the fonn of an image S. The data on the basis of which the image 
can be constructed is possibly already in the form of a grid or matrix corresponding with the 

1 0 pixels of the image, with for each pixel a numerical source value indicating a colour value or, 
with a view to the method according to the invention, is brought into such a form. In the case 
of a monochromatic image the colour value amounts only to an intensity, for instance a grey 
value; in the case of a colour image this will be a set of for instance three values^ one fox each 
basic colour. A much used format in which images are digitally stored is the so-called bitmap 

15 format which, for each pixel of a colour image, comprises three channels of 8 bits each, and 
therefore has 256 values for each basic colour. This format can be employed relatively 
directly by the method according to the invention, other formats possibly require a conversion 
similar to that with which such a format is transferred to the (image) memory of a computer. 

20 Assuming a black/white image S, a part of the thus assembled matrix is shown by the grid of 
figure 7, wherein the points in the grid represent the pixels of the source image S with for each 
grid point Sjj a discrete value of Ijj from 0 to 255 from the matrix to thereby designate the grey 
value of the relevant pixeL hi order to enlarge such an image while retaining resolution, 
intermediate points have to be created, of which the value of the grey value has to be 

25 calculated. One of these points T is shown in the figure, 

A first estimate of the grey value Ij of the intermediate pixel T can be obtained by interpolation 
on the basis of the values of the surrounding pixels. The point of departure herefor in this 
example is a weighted average of the values of the surrounding pixels, wherein the weighting 
30 assigned to each pixel is highly dependent on its distance fi:om T. A more particular poiut of 
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departure liereiii for the wei^ting factors is a normalized Gaussian distribution, of whicli pixel 
T forms liie origin- Because of the sharp fall in the weighting fectors according to this curve, a 
finite region A of for instance 4x4 pixels around T suffices for the interpolation, which pixels 
are hatched in the fig;ure. On the basis of this interpolation an interpolated grey value results 
for the pixel T to be calculated in accordance wili. the following relation: 



According to the invention a local maximum and a local minimum around tlie pixel T to be 
calculated is also determined in addition to the interpolated value P^. In the embodimCTl 
described here tlie starting point for this purpose is a reference region B of 4x4 pixels S.i.. 
33S0.0— an origin Sq^q which is formed by the pixel in the original image lying just in front 
of the pixel for calculating. This region is shown hatched in the figure. A local maximum 1^^^ 
and a local minimum I^in of the grey values of the original pixels are determined wthin this 
region. 

In addition, the local dynamics in the grey values are determined according to liie invention 
within a reference region around the pixel T for calculating. The starting point therefor in this 
embodiment is the same reference region B as that in which the local minimum and maximum 
have been determined. These dynamics provide a measure for the hardness or contrast of the 
image and are derived in this embodiment from tie normalized average difference between the 
grey values of the pixels Sy in reference region B and a weighted average of the pixels in a 
reference region C of 5x5 pixels around the pixel S^j for which the local dynamics has to be 
calculated. This region C therefore differs for each pixel Sy and is indicated by way of 
example in the figure for Soo- This is expressed in the following formula: 





where I^m = ^p^-^n '>*'2ffi ^Ov-l and ^Gpq~\ 
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The-starting point for the weighted average 1^^^ here are weighting factors on the basis of 
a normalized Gaussian distribution which attributes a greater weighting to pixels close to the 
pixel T for calculating than to further removed pixels. For the resulting factor Djj there applies: 
5 0 < Dij < 1 . A value Dy— 1 indicates that the source image in the relevant region is very hard, 
i.e. has very sharp transitions in intensity, while a value Dij=0 indicates precisely the opposite, 
i.e. no differences in intensity occur within the region. Hie local dynamics associated with 
the pixel T to be calculated are derived from the weighted average of the values Djj from the 
reference region B around the pixel T to be calculated. 

10 

The grey value of the pixel T to be calculated is established by adjusting fee interpolated value 
P, to the local maximum or mimTniim on the basis of the thus found hardness value D,. Taken 
for this purpose in this embodiment is a weighted average of Pt and the local maximum and 
minimum, wherein a weighting factor is apphed which depends on the difference from P^ and is 
15 proportional to the hardness value D^. This is expressed for instance by the following fomiula 
apphed in this 
example: 

where sino(f) = K + K.sin«r - K) and sinn(f) = sine, sin « - i(t) with n^5 

20 If in the relevant reference region B the source image is completely level and has no 

differences in intensity, which is reflected by a value D=0, no shifting or adjustment of the 
interpolated value P^, takes place. In the case of a comparatively hard image witih great 
differences in intensity, wherein D will move in tiic direction of a value D= 1^ the adjustment 
win in contrast be maximal. The final value I^ will in that case be shifted to the local minimum 

25 or maximum, depending on which value hes closest to the interpolated value P^ thereby 

resulting in more deiinition. The local dynamics of the original image S are thus taken into 
account in the final grey value 1^, which is calculated for the pixel T to be added. 
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The foregoing algorittm is applied for all pixels which have to be calcnlated among or 
adjacently of the original pixels in order to create the desired CTlargement while retaining 
resolution. In practice this means that for all pixels of the original source image the associated 
local maxima, minima and average hardness values are calculated beforehand so that these are 
then immediately available for liie above stated calculations. The stated algorithm allows of 
simple translation into computer software with which a suitable compnter can be loaded to 
perform the calculations fully automatically. In a user interface ad^ted thereto setting options 
can be offered for fine-tuning of the size of the reference regions, the relations for the 
weighting factors and other parameters. 

The result on the basis of this embodim^t of the method accorduig to the invention is shown 
in figures 3 and 6 for respectively a relatively hard source image in the form of a shaiply 
defined character and a more variegated source image coiresponding with a photographic 
image. It can clearly be seen that the definition of the character in figure 3 has been retained 
despite the great enlargement thereof^ while the variegation in the image of figure 6 is retained 
with the method according to the invention and is even better preserved than on the basis of 
solely an interpolation method as shown in figure 5. 

Although the invention has been further elucidated above with reference to only two 
embodiments, it will be apparent that the invention is by no means limited to the given 
embodiments. The invention can thus also be applied to images with more colours, wherein 
the above stated algorithm is applied separately to each basic colour. The invention can 
advantageously also be applied for the interpolation of sound data and other data with 
noncritical bit values while retaining dynamics. The above stated wei^ting factors and firames 
of reference, although very effective, have been given solely as examples. Depending on the 
concrete situation, a fine-tuning thereof can take place to further enhance the quality of the 
final result. Larger, smaller or identical reference regions can for instance thus be applied to 
calculate the various above stated factors and, in ord^ to determine the final grey value of the 
pixel for calculating^ a different algorithm can also be chosen which takes account of the local 
dynamics derived in this pixel and the local maximum and miriiTnum. 
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The invention generally provides a method of interpolating data while retaining dynamics, 
which impHes that the character and the definition of the source data is retained to a significant 
degree in the result. 
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Claims 

1 . Met±Lod for processing data in the form of a grid of discrete soiirce values, wherein at 
least one target value (T) within a region (A) of sotrrce values is detennined by means of 
interpolation in said region (A) of source values characterised in that a miTiirmirn value (1^ 
and a maximum value CTmax) 3re detennined within a local region of source values around the 
target value (T), in that a measure of the dynamics is detemiined within a local region (B) of 
source values around the target value (T) and in that the target value is calculated by weighted 
inteipolation is adjusted in the direction of either said minimum value or said maximum value 
on the basis of said determined measure of the dyaamics, 

2. Method according to claim 1 characterised in that said measure of dynamics is 
determined as a normalized weighted value of the absolute differences - Igcmil) ^ source 
values within said local region (B). 

3. Method according to claim 2 characterized in that one of said absolute differences 

- IgemOj)!!) is calculated for each one of the source values in said local region (B), and in 
that each said difference - Igcmdj)!!) is calculated between a givOT one (Jip ijeB) of said 
source values and a weighted average (Igcmcij)) source values in a further local region (C) 
corresponding to said given one source value, 

4. Method according to any of the preceding claims characterized in that the direction in 
which said adjustement is performed depends on the relative dtSerence between said target 
vahie calculated by weighted interpolation (Pi) and said Tninimum and maximum value 

(Iminslmax)- 

5. Method according to any of the preceding claims characterized in that use is made of 
weighted interpolation on the basis of a non-linear density distribution which assigns a heavier 
weighting to source values located closer in the grid than to source values located further 
away, in particular a Gaussian distribution, at least an e^qjonential density distribution. 



AMENDED SHEET 



-12- 

6. Method according to any of the preceding claims characterized in that a source value 
which lies in the grid closest to the target value to be determined, is taken as source of a 
region extending over a finite number of mutually adjacent source values and that the local 
maximum and the local miTiimuTn are determined in this region. 

7. Method as claimed in claim 6, characterized in that the measure for the dynamics of 
the source values is determined in a second region extending over a finite number of mutually 
adjacent source values, which second region is optionally of the same size as the first region in 
which the local maximum and mimmum are determined. 

8. Method as claimed in claim 7, characterized in that the dynamics are derived from a 
normalized difference between a source value and an average of all source values in the 
second region. 

9. Method as claimed in claim 8, characterized in that for the average of all source values 
in the second region a weighted average is taken which assigns a heavier weighting to 

source values located closer in the grid than to source values located further away and which 
particularly utilizes a non-linear density distribution for the purpose of determining the 
weighting factors and more particularly from a Gaussian distribution, at least from an 
exponential density distribution. 

10. Method according to any of the preceding claims characterized in that the final target 
value is a weighted average of the target value determined on the basis of interpolation and the 
local maximum and minimum, wherein a weighting factor is employed which depends on 
average local dynamics of the source values located around the target value to be detemiined 
and the relative location of the target value detexmiaed on the basis of interpolation relative to 
the local maximum and minimum. 
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Fig.4 
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